Pandas Profiling Report

Dataset statistics

Number of variables	12
Number of observations	2968
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	301.4 KiB
Average record size in memory	104.0 B

Variable types

Numeric	12

Alerts

`gross_revenue` is highly overall correlated with `qtde_invoice` and 3 other fields	High correlation
`recency_days` is highly overall correlated with `qtde_invoice`	High correlation
`qtde_invoice` is highly overall correlated with `gross_revenue` and 2 other fields	High correlation
`qtde_items` is highly overall correlated with `gross_revenue` and 4 other fields	High correlation
`qtde_products` is highly overall correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_size` is highly overall correlated with `gross_revenue` and 4 other fields	High correlation
`avg_unique_basket_size` is highly overall correlated with `qtde_products` and 1 other fields	High correlation
`freq` is highly overall correlated with `avg_rec_days`	High correlation
`avg_ticket` is highly overall correlated with `avg_basket_size` and 1 other fields	High correlation
`avg_rec_days` is highly overall correlated with `freq`	High correlation
`qtde_returns` is highly overall correlated with `qtde_items` and 2 other fields	High correlation
`avg_ticket` is highly skewed (γ1 = 25.15677718)	Skewed
`qtde_returns` is highly skewed (γ1 = 26.84619429)	Skewed
`customer_id` has unique values	Unique
`recency_days` has 33 (1.1%) zeros	Zeros
`qtde_returns` has 1481 (49.9%) zeros	Zeros

Reproduction

Analysis started	2022-12-20 12:52:39.945868
Analysis finished	2022-12-20 12:53:15.696102
Duration	35.75 seconds
Software version	pandas-profiling vv3.5.0
Download configuration	config.json

customer_id
Real number (ℝ)

Distinct	2968
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15270.377

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	12347
5-th percentile	12619.35
Q1	13798.75
median	15220.5
Q3	16768.5
95-th percentile	17964.65
Maximum	18287
Range	5940
Interquartile range (IQR)	2969.75

Descriptive statistics

Standard deviation	1719.1445
Coefficient of variation (CV)	0.11258036
Kurtosis	-1.2061782
Mean	15270.377
Median Absolute Deviation (MAD)	1489
Skewness	0.032193711
Sum	45322479
Variance	2955457.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
12670	1	< 0.1%
17734	1	< 0.1%
14905	1	< 0.1%
16103	1	< 0.1%
14626	1	< 0.1%
14868	1	< 0.1%
18246	1	< 0.1%
17115	1	< 0.1%
16611	1	< 0.1%
Other values (2958)	2958	99.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12364	1	< 0.1%
12370	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18277	1	< 0.1%
18276	1	< 0.1%
18274	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18269	1	< 0.1%

gross_revenue
Real number (ℝ)

Distinct	2953
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2691.263

Minimum	6.2
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	6.2
5-th percentile	229.7325
Q1	570.845
median	1083.905
Q3	2306.905
95-th percentile	7169.562
Maximum	279138.02
Range	279131.82
Interquartile range (IQR)	1736.06

Descriptive statistics

Standard deviation	10113.975
Coefficient of variation (CV)	3.7580775
Kurtosis	399.25289
Mean	2691.263
Median Absolute Deviation (MAD)	671.49
Skewness	17.664809
Sum	7987668.7
Variance	1.0229249 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1078.96	2	0.1%
2053.02	2	0.1%
331	2	0.1%
1353.74	2	0.1%
889.93	2	0.1%
745.06	2	0.1%
379.65	2	0.1%
2092.32	2	0.1%
731.9	2	0.1%
734.94	2	0.1%
Other values (2943)	2948	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
6.2	1	< 0.1%
13.3	1	< 0.1%
15	1	< 0.1%
36.56	1	< 0.1%
45	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
136263.72	1	< 0.1%
124564.53	1	< 0.1%
116725.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%
65019.62	1	< 0.1%

recency_days
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	272
Distinct (%)	9.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.31031

Minimum	0
Maximum	373
Zeros	33
Zeros (%)	1.1%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	11
median	31
Q3	81
95-th percentile	242
Maximum	373
Range	373
Interquartile range (IQR)	70

Descriptive statistics

Standard deviation	77.760314
Coefficient of variation (CV)	1.2091423
Kurtosis	2.7765932
Mean	64.31031
Median Absolute Deviation (MAD)	26
Skewness	1.7980702
Sum	190873
Variance	6046.6664
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.3%
4	87	2.9%
2	85	2.9%
3	85	2.9%
8	76	2.6%
10	67	2.3%
9	66	2.2%
7	66	2.2%
17	64	2.2%
22	55	1.9%
Other values (262)	2218	74.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	33	1.1%
1	99	3.3%
2	85	2.9%
3	85	2.9%
4	87	2.9%
5	43	1.4%
7	66	2.2%
8	76	2.6%
9	66	2.2%
10	67	2.3%

Value	Count	Frequency (%)
373	2	0.1%
372	4	0.1%
371	1	< 0.1%
368	1	< 0.1%
366	4	0.1%
365	2	0.1%
364	1	< 0.1%
360	1	< 0.1%
359	1	< 0.1%
358	4	0.1%

qtde_invoice
Real number (ℝ)

Distinct	57
Distinct (%)	1.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.7230458

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	205
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	8.8485429
Coefficient of variation (CV)	1.5461248
Kurtosis	189.99723
Mean	5.7230458
Median Absolute Deviation (MAD)	2
Skewness	10.741904
Sum	16986
Variance	78.296712
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	785	26.4%
3	498	16.8%
4	393	13.2%
5	237	8.0%
1	190	6.4%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	70	2.4%
11	54	1.8%
Other values (47)	332	11.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	190	6.4%
2	785	26.4%
3	498	16.8%
4	393	13.2%
5	237	8.0%
6	173	5.8%
7	138	4.6%
8	98	3.3%
9	70	2.4%
10	54	1.8%

Value	Count	Frequency (%)
206	1	< 0.1%
198	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	0.1%
60	1	< 0.1%
57	1	< 0.1%

qtde_items
Real number (ℝ)

Distinct	1669
Distinct (%)	56.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1579.6698

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	101.35
Q1	296
median	638
Q3	1398.25
95-th percentile	4403.25
Maximum	196844
Range	196843
Interquartile range (IQR)	1102.25

Descriptive statistics

Standard deviation	5700.0984
Coefficient of variation (CV)	3.6084113
Kurtosis	518.2266
Mean	1579.6698
Median Absolute Deviation (MAD)	419
Skewness	18.7615
Sum	4688460
Variance	32491122
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
150	9	0.3%
88	9	0.3%
134	8	0.3%
272	8	0.3%
288	8	0.3%
84	8	0.3%
260	8	0.3%
246	8	0.3%
200	7	0.2%
Other values (1659)	2884	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
2	2	0.1%
12	2	0.1%
16	1	< 0.1%
17	1	< 0.1%
18	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
23	1	< 0.1%
25	1	< 0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
79879	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
62812	1	< 0.1%
58243	1	< 0.1%
57772	1	< 0.1%
50255	1	< 0.1%

qtde_products
Real number (ℝ)

Distinct	469
Distinct (%)	15.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	122.7035

Minimum	1
Maximum	7837
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	9
Q1	29
median	67
Q3	135
95-th percentile	382
Maximum	7837
Range	7836
Interquartile range (IQR)	106

Descriptive statistics

Standard deviation	269.2812
Coefficient of variation (CV)	2.1945681
Kurtosis	354.34185
Mean	122.7035
Median Absolute Deviation (MAD)	44
Skewness	15.67683
Sum	364184
Variance	72512.365
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28	46	1.5%
20	38	1.3%
35	35	1.2%
15	33	1.1%
29	32	1.1%
19	32	1.1%
11	32	1.1%
26	31	1.0%
18	30	1.0%
27	30	1.0%
Other values (459)	2629	88.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	6	0.2%
2	14	0.5%
3	15	0.5%
4	17	0.6%
5	26	0.9%
6	29	1.0%
7	18	0.6%
8	19	0.6%
9	27	0.9%
10	27	0.9%

Value	Count	Frequency (%)
7837	1	< 0.1%
5586	1	< 0.1%
5095	1	< 0.1%
4577	1	< 0.1%
2698	1	< 0.1%
2379	1	< 0.1%
2060	1	< 0.1%
1818	1	< 0.1%
1673	1	< 0.1%
1636	1	< 0.1%

avg_basket_size
Real number (ℝ)

Distinct	1973
Distinct (%)	66.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	235.83169

Minimum	1
Maximum	6009.3333
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	44
Q1	103.2375
median	172
Q3	281.375
95-th percentile	598.345
Maximum	6009.3333
Range	6008.3333
Interquartile range (IQR)	178.1375

Descriptive statistics

Standard deviation	283.87459
Coefficient of variation (CV)	1.2037169
Kurtosis	102.86589
Mean	235.83169
Median Absolute Deviation (MAD)	82.625
Skewness	7.7098453
Sum	699948.45
Variance	80584.784
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
114	10	0.3%
82	9	0.3%
73	9	0.3%
86	9	0.3%
75	8	0.3%
136	8	0.3%
140	8	0.3%
60	8	0.3%
88	8	0.3%
Other values (1963)	2880	97.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2	0.1%
2	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%

Value	Count	Frequency (%)
6009.333333	1	< 0.1%
4282	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2801	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%
2082.225806	1	< 0.1%

avg_unique_basket_size
Real number (ℝ)

Distinct	1009
Distinct (%)	34.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	22.158128

Minimum	1
Maximum	299.70588
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	3.4021531
Q1	10
median	17.2
Q3	27.75
95-th percentile	56.9475
Maximum	299.70588
Range	298.70588
Interquartile range (IQR)	17.75

Descriptive statistics

Standard deviation	19.512566
Coefficient of variation (CV)	0.88060535
Kurtosis	27.705366
Mean	22.158128
Median Absolute Deviation (MAD)	8.2
Skewness	3.4995256
Sum	65765.325
Variance	380.74025
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
13	54	1.8%
14	40	1.3%
11	38	1.3%
9	33	1.1%
18	33	1.1%
1	32	1.1%
20	31	1.0%
10	30	1.0%
16	29	1.0%
17	28	0.9%
Other values (999)	2620	88.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	32	1.1%
1.2	1	< 0.1%
1.25	1	< 0.1%
1.333333333	2	0.1%
1.5	7	0.2%
1.568181818	1	< 0.1%
1.571428571	1	< 0.1%
1.666666667	4	0.1%
1.833333333	1	< 0.1%
2	24	0.8%

Value	Count	Frequency (%)
299.7058824	1	< 0.1%
259	1	< 0.1%
203.5	1	< 0.1%
148	1	< 0.1%
145	1	< 0.1%
136.125	1	< 0.1%
135.5	1	< 0.1%
127	1	< 0.1%
122	1	< 0.1%
118	1	< 0.1%

freq
Real number (ℝ)

Distinct	1348
Distinct (%)	45.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.063285225

Minimum	0.0054495913
Maximum	3
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0.0054495913
5-th percentile	0.0094339623
Q1	0.017777778
median	0.029411765
Q3	0.055440135
95-th percentile	0.22222222
Maximum	3
Range	2.9945504
Interquartile range (IQR)	0.037662358

Descriptive statistics

Standard deviation	0.13449713
Coefficient of variation (CV)	2.1252533
Kurtosis	121.53966
Mean	0.063285225
Median Absolute Deviation (MAD)	0.01432783
Skewness	8.7727252
Sum	187.83055
Variance	0.018089479
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.3333333333	21	0.7%
0.1666666667	21	0.7%
0.02777777778	20	0.7%
0.09090909091	19	0.6%
0.0625	17	0.6%
0.4	16	0.5%
0.1333333333	16	0.5%
0.03571428571	15	0.5%
0.02380952381	15	0.5%
0.25	15	0.5%
Other values (1338)	2793	94.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005494505495	1	< 0.1%
0.005509641873	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
3	1	< 0.1%
2	1	< 0.1%
1.571428571	1	< 0.1%
1.5	3	0.1%
1	14	0.5%
0.8333333333	1	< 0.1%
0.75	1	< 0.1%
0.6666666667	12	0.4%
0.6487935657	1	< 0.1%
0.6	1	< 0.1%

avg_ticket
Real number (ℝ)

HIGH CORRELATION
SKEWED

Distinct	2965
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	32.989799

Minimum	2.1505882
Maximum	4453.43
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	2.1505882
5-th percentile	4.915888
Q1	13.118111
median	17.936066
Q3	24.882907
95-th percentile	90.052125
Maximum	4453.43
Range	4451.2794
Interquartile range (IQR)	11.764796

Descriptive statistics

Standard deviation	119.53254
Coefficient of variation (CV)	3.6233182
Kurtosis	812.9555
Mean	32.989799
Median Absolute Deviation (MAD)	5.9616373
Skewness	25.156777
Sum	97913.724
Variance	14288.028
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
15	2	0.1%
4.162	2	0.1%
14.47833333	2	0.1%
18.15222222	1	< 0.1%
13.92736842	1	< 0.1%
36.24411765	1	< 0.1%
29.78416667	1	< 0.1%
22.8792623	1	< 0.1%
20.51104167	1	< 0.1%
149.025	1	< 0.1%
Other values (2955)	2955	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
4453.43	1	< 0.1%
3202.92	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%
615.75	1	< 0.1%

avg_rec_days
Real number (ℝ)

Distinct	1258
Distinct (%)	42.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	67.305053

Minimum	1
Maximum	366
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	1
5-th percentile	8
Q1	25.927198
median	48.267857
Q3	85.333333
95-th percentile	200.65
Maximum	366
Range	365
Interquartile range (IQR)	59.406136

Descriptive statistics

Standard deviation	63.503259
Coefficient of variation (CV)	0.94351399
Kurtosis	4.9086453
Mean	67.305053
Median Absolute Deviation (MAD)	26.267857
Skewness	2.0662224
Sum	199761.4
Variance	4032.6639
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14	25	0.8%
4	22	0.7%
70	21	0.7%
7	20	0.7%
35	19	0.6%
49	18	0.6%
11	17	0.6%
46	17	0.6%
21	17	0.6%
28	16	0.5%
Other values (1248)	2776	93.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	16	0.5%
1.5	1	< 0.1%
2	13	0.4%
2.5	1	< 0.1%
2.601398601	1	< 0.1%
3	15	0.5%
3.321428571	1	< 0.1%
3.330357143	1	< 0.1%
3.5	2	0.1%
4	22	0.7%

Value	Count	Frequency (%)
366	1	< 0.1%
365	1	< 0.1%
363	1	< 0.1%
362	1	< 0.1%
357	2	0.1%
356	1	< 0.1%
355	2	0.1%
352	1	< 0.1%
351	2	0.1%
350	3	0.1%

qtde_returns
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	172
Distinct (%)	5.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	24.984164

Minimum	0
Maximum	9014
Zeros	1481
Zeros (%)	49.9%
Negative	0
Negative (%)	0.0%
Memory size	46.4 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	1
Q3	6
95-th percentile	62.65
Maximum	9014
Range	9014
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	228.65147
Coefficient of variation (CV)	9.1518557
Kurtosis	912.13278
Mean	24.984164
Median Absolute Deviation (MAD)	1
Skewness	26.846194
Sum	74153
Variance	52281.494
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1481	49.9%
1	295	9.9%
3	169	5.7%
6	93	3.1%
2	87	2.9%
4	71	2.4%
5	43	1.4%
12	43	1.4%
8	40	1.3%
7	38	1.3%
Other values (162)	608	20.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1481	49.9%
1	295	9.9%
2	87	2.9%
3	169	5.7%
4	71	2.4%
5	43	1.4%
6	93	3.1%
7	38	1.3%
8	40	1.3%
9	36	1.2%

Value	Count	Frequency (%)
9014	1	< 0.1%
4824	1	< 0.1%
4027	1	< 0.1%
2302	2	0.1%
1776	1	< 0.1%
1608	1	< 0.1%
1589	1	< 0.1%
1515	1	< 0.1%
1278	1	< 0.1%
1242	1	< 0.1%

Auto

The auto setting is an interpretable pairwise column metric of the following mapping:

Variable_type-Variable_type : Method, Range
Categorical-Categorical : Cramer's V, [0,1]
Numerical-Categorical : Cramer's V, [0,1] (using a discretized numerical column)
Numerical-Numerical : Spearman's ρ, [-1,1]

The number of bins used in the discretization for the Numerical-Categorical column pair can be changed using config.correlations["auto"].n_bins. The number of bins affects the granularity of the association you wish to measure.

This configuration uses the recommended metric for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	customer_id	gross_revenue	recency_days	qtde_invoice	qtde_items	qtde_products	avg_basket_size	avg_unique_basket_size	freq	avg_ticket	avg_rec_days	qtde_returns
0	17850.0	5391.21	372.0	34.0	1733.0	297.0	50.970588	8.735294	0.486111	18.152222	35.500000	21.0
1	13047.0	3232.59	56.0	9.0	1390.0	171.0	154.444444	19.000000	0.048780	18.904035	27.250000	6.0
2	12583.0	6705.38	2.0	15.0	5028.0	232.0	335.200000	15.466667	0.045699	28.902500	23.187500	50.0
3	13748.0	948.25	95.0	5.0	439.0	28.0	87.800000	5.600000	0.017921	33.866071	92.666667	0.0
4	15100.0	876.00	333.0	3.0	80.0	3.0	26.666667	1.000000	0.136364	292.000000	8.600000	22.0
5	15291.0	4623.30	25.0	14.0	2102.0	102.0	150.142857	7.285714	0.054441	45.326471	23.200000	27.0
6	14688.0	5630.87	7.0	21.0	3621.0	327.0	172.428571	15.571429	0.073569	17.219786	18.300000	281.0
7	17809.0	5411.91	16.0	12.0	2057.0	61.0	171.416667	5.083333	0.039106	88.719836	35.700000	41.0
8	15311.0	60767.90	0.0	91.0	38194.0	2379.0	419.714286	26.142857	0.315508	25.543464	4.144444	231.0
9	16098.0	2005.63	87.0	7.0	613.0	67.0	87.571429	9.571429	0.024390	29.934776	47.666667	0.0

	customer_id	gross_revenue	recency_days	qtde_invoice	qtde_items	qtde_products	avg_basket_size	avg_unique_basket_size	freq	avg_ticket	avg_rec_days	qtde_returns
5626	17727.0	1060.25	15.0	1.0	645.0	66.0	645.000000	66.0	0.285714	16.064394	6.0	6.0
5636	17232.0	421.52	2.0	2.0	203.0	36.0	101.500000	18.0	0.153846	11.708889	12.0	0.0
5637	17468.0	137.00	10.0	2.0	116.0	5.0	58.000000	2.5	0.400000	27.400000	4.0	0.0
5648	13596.0	697.04	5.0	2.0	406.0	166.0	203.000000	83.0	0.250000	4.199036	7.0	0.0
5654	14893.0	1237.85	9.0	2.0	799.0	73.0	399.500000	36.5	0.666667	16.956849	2.0	0.0
5658	12479.0	473.20	11.0	1.0	382.0	30.0	382.000000	30.0	0.333333	15.773333	4.0	34.0
5679	14126.0	706.13	7.0	3.0	508.0	15.0	169.333333	5.0	1.000000	47.075333	3.0	50.0
5685	13521.0	1092.39	1.0	3.0	733.0	435.0	244.333333	145.0	0.300000	2.511241	4.5	0.0
5695	15060.0	301.84	8.0	4.0	262.0	120.0	65.500000	30.0	2.000000	2.515333	1.0	0.0
5714	12558.0	269.96	7.0	1.0	196.0	11.0	196.000000	11.0	0.285714	24.541818	6.0	102.0

Overview

Variables

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample